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Air  vehicles  of  the  future,  whether  they  be  CTOL  or  V/STOL  air- 
craft, will  almost  surely  be  control  configured  vehicles  that  make  extensive 
use  of  active  control  technology.  Multiple  means  of  producing  primary  forces 
and  moments  on  the  vehicle  for  enhanced  maneuverability  will  likely  be  common- 
place. The  technology  to  be  used  to  conceptually  design  a multicontroller 
feedback  system  to  satisfy  flying  qualities  and  other  control  system  design 
criteria  is  an  emerging  technology.  Almost  always,  the  purpose  of  a feedback 
flight  control  or  stability  augmentation  system  is  to  enhance  the  flying  qual- 
ities of  the  aircraft.  To  be  most  effective  and  responsive  to  the  needs  of 
Naval  Aviation,  one  major  thrust  of  flight  control  system  design  criteria 
should  be  toward  the  most  efficient  way  to  satisfy  flying  qualities  require- 
ments as  defined  by  MIL-F-8785B(ASG)  or  MIL-F-83300,  the  only  military  CTOL 
or  V/STOL  specifications. 

The  objective  of  the  research  described  in  this  paper  is  to  inves- 
tigate multicontroller  control  system  design  techniques  that  will  satisfy  fly- 
ing qualities  requirements.  Augmented  systems  which  do  not  increase  the  order 
of  the  closed  loop  system  are  desirable  because  they  tend  to  avoid  problems 
associated  with  phase  shift  and  apparent  time  delays,  they  are  less  complex  and 
easier  to  implement.  The  resulting  dynamics  of  such  augmented  systems  can  be 
readily  interpreted  in  terms  of  the  current  specifications  on  conventional  phu- 
goid,  short  period,  Dutch  roll,  roll  and  spiral  vehicle  dynamic  modes  and  the 
zeros  of  the  transfer  functions  of  substantial  significance  to  the  flight  dyna- 
mics situation  as  defined  by  MIL-F-878SB  or  MIL-F-83300. 

What  is  needed  then,  is  a multicontroller  design  method  that  uses 
only  passive  feedback  gains.  The  control  system  design  of  the  near  future 
will  wish  to  achieve  objectives  in  addition  to  satisfying  flying  qualities, 
such  as  bending  moment  and  maneuver  drag  minimization  or  gust  alleviation. 

Only  by  using  optimal  control  methods  can  the  control  system  designer  hope  to 


obtain  a multicontroller  design  that  not  only  achieves  objectives  such  as  min- 
imum maneuver  loads  and  acceptable  flying  qualities  as  defined  by  MIL-F-8785B, 
but  also  does  not,  in  general,  increase  the  dynamic  order  of  the  system  response. 


A brief  survey  of  the  evolution  of  flight  control  design  prac- 
tices over  the  past  fifteen  years  shows  the  following  trends: 

1.  Flight  control  systems  require  more  sensors  that  measure 
dynamic  motions  of  the  aircraft,  resulting  in  an  increased 
number  of  feedback  paths. 

2.  Filter  or  compensation  networks  as  command  augmentation 
are  introduced  to  modify  pilot  command  inputs  to  the  servos 
that  drive  the  aerodynamic  surfaces. 

3.  Filters,  compensation  networks  and  washout  networks  are 
being  added  in  abundance  to  the  flight  control  system. 


4. 
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"Inner  loops"  in  the  form  of  feedback  to  surfaces  not  di- 
rectly commanded  by  the  pilot  are  being  proposed.  An  exam- 
ple would  be  a direct  lift  flap  or  spoiler  programmed  for 
gust  alleviation. 


These  developments  taken  individually  may  be  justified  for  indi- 
vidual airframes  and  flight  tasks  but  the  tendency  is  to  build  upon  previous 
designs  by  cascading  resulting  in  increased  complexity  and  a very  high  order 
system. 


The  purpose  of  the  research  described  in  this  report  is  to  evolve 
flight  control  system  design  methods  that  are  compatible  with  flying  qualities 
specifications  as  they  now  exist  and  are  potentially  more  systematic  and  power- 
ful in  the  sense  of  achieving  flight  control  objectives  more  quickly  and  more 
effectively.  Linear  optimal  control  is  one  of  the  most  rapid  and  potentially 
most  efficient  methods  of  designing  multi-input,  multi-output  systems. 
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Because  the  linear  optimal  control  law  inherently  involves  feedback  through  non- 
energy storage  gains  only,  the  order  of  the  closed-loop  response  is  not  in- 
creased as  compared  to  the  open-loop  response.  Therefore,  MIL-F-8785B  can  be 
used  directly  to  determine  the  effect  of  the  optimal  control  system  on  the 
resulting  flying  qualities  of  the  aircraft.  If  flying  qualities  objectives 
can  be  directly  included  in  the  performance  index  to  be  traded  off  or  evaluated 
along  with  active  control  objectives,  then  linear  optimal  control  methods  may 
be  developed  into  an  attractive  and  powerful  tool  for  the  flight  control  sys- 
tem designer. 

Flying  qualities  requirements  as  presently  specified  by  MIL-F- 
8785B  define,  among  other  things,  acceptable  regions  for  poles  and  zeros  of 
transfer  functions  of  specific  response  variables  with  respect  to  pilot  com- 
mand inputs.  If  linear  optimal  control  is  to  be  a viable  design  tool  that 
can  lead  directly  to  flight  control  configurations  satisfying  flying  quali- 
ties, then  direct  relationships  connecting  the  performance  index  parameters 
with  the  resulting  closed-loop  poles  and  transfer  function  zeros  should  be 
available  to  the  designer.  This  report  directly  addresses  the  problem  of 
performance  index  selection  and  the  effect  of  this  selection  on  the  closed- 
loop  poles  and  transfer  function  zeros,  the  handling  qualities  parameters. 


Linear  optimal  control  methods  have  disadvantages.  The  feedback 
control  law  obtained  by  linear  optimal  methods  in  general  requires  feedback 
from  each  state  to  each  controller,  resulting  in  a complexity  that  is  never 
necessary  and  never  justifiable.  Satisfactory  flying  qualities  are  defined 
for  a fairly  broad  range  of  closed-loop  dynamics,  so  a simplified  closed-loop 
configuration  seems  always  possible.  Because  a fully  optimal  feedback  sys- 
tem can  be  considered  to  be  of  a complexity  comparable  to  some  recent  high 
order  flight  control  systems,  a suboptimal  system  should  yield  a configuration 
that  is  simpler,  lower  order  and  have  significantly  better  flying  qualities. 


Organization  of  the  Report 

Section  two  of  this  report  briefly  outlines  the  linear  optimal 
control  problem  stressing  the  role  played  by  transfer  function  and  other 
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zeros  in  the  optimal  control  problem  and  the  effect  of  transfer  function  zeros 
on  the  closed-loop  dynamic  behavior  of  the  optimal  system.  Section  three 
describes  two  methods  that  might  be  further  developed  to  obtain  relationships 
between  performance  index  parameters  and  zeros  of  closed-loop  transfer  func- 
tions. Section  4 describes  two  potentially  useful  alternative  design  tech- 
niques. Finally,  design  examples  are  given  in  Section  S to  illustrate  the 
principles  developed  in  earlier  sections  of  the  report. 


Section  2 

CHARACTERISTICS  OF  LINEAR  OPTIMAL  SYSTEMS 
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Linear  optimal  control,  as  generally  applied  to  aircraft,  involves 
the  minimization  of  a quadratic  form  of  scalar  performance  index 

oO 

2V  = min  J (y^Qy  + uT  Ru)dt  (2-1) 

u o 

subject  to  the  constraint  of  the  familiar  linearized,  small  perturbation  equa- 
tions of  aircraft  motion 


x = Fx  + Gu  (2-2a) 

y = Hx  (2-2b) 

where  x is  a vector  whose  components  represent  the  state  or  motion  variables 
of  the  aircraft,  u is  a vector  that  represents  the  control  input  variables 
such  as  aileron,  rudder  and  elevator  deflection  and  y is  a vector  whose  compo- 
nents usually  represent  either  the  measured  quantities  of  the  vehicle  motion 
or  the  vehicle  motions  that  are  to  be  minimized  by  the  performance  index  se- 
lection. 


Many  methods  for  solving  this  problem  are  in  existence,  but  prob- 
ably the  most  common  and  straightforward  method  is  based  upon  a straightfor- 
ward calculas  of  variations  approach  (Reference  3 ) . A Lagrangian  function 
is  defined  as 

L = j (xTHTQHx  + uT  Ru)  + AT(-x  + Fx  + Gu)  (2-3) 

where  A is  a vector  of  Lagrange  multipliers  often  called  the  adjoint  state 
vector  or  costate  of  the  system.  The  resultant  Euler-Lagrange  equations  that 
must  be  satisfied  to  guarantee  a minimum  of  the  performance  index  are  given 
by 


£ 0 or  hTQH*  + pT * * * s 0 (2-4*) 


: 


> 


or  Ru  + G^A  = 0 (2-4b) 

or  -x  + Fx  + Gu  = 0 (2-4c) 

For  a non-negative  definite  output  weighting  matrix  Q and  positive 
definite  weighting  matrix  R in  the  performance  index  of  Equation  (2-1),  the 
solution  is  guaranteed  stable.  These  are  necessary  and  sufficient  conditions 
for  stability,  but  relaxation  of  these  conditions  need  not  yield  an  unstable 
closed-loop  system.  From  Equation  (2-4b)  the  optimal  control  law  is  obtained 
as 

u = -R-1  GTA  (2-5) 

It  has  been  proven  that  A is  a linear  function  of  x, 
i.e.  A = Px.  Substitution  of  A = Px  into  equations  (2-4)  and  a little 
algebra  yields  the  familiar  Riccati  equation 

0 = PF  + FTP  - PGR_1GTP  + HTQH  (2-6) 

whose  positive  definite  symmetric  solution  yields  the  optimal  feedback  con- 
trol law 

u = -R_1GTPx  (2-7) 

Effect  of  Performance  Index  Selection  on  Closed-Loop  Dynamical  Behavior 

The  optimal  regulator  as  defined  by  the  feedback  control  law  of 
Equation  (2-7)  and  the  equations  of  motion  (2-2)  has  an  optimal  response  for 
any  excitation  to  the  system,  whether  the  excitation  be  initial  condition  on 
the  state,  disturbance  inputs  or  pilot  command  inputs.  Without  attempting 
to  downplay  or  relegate  the  disturbance  inputs  to  a lesser  role,  it  is  the 
command  or  pilot  inputs  that  are  most  important  to  flying  qualities. 
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Optimal  control  is  a "black  box",  input-output  design  technique. 
When  designing  an  optimal  system  to  be  commanded  by  a pilot,  a more  obvious 
method  for  definition  of  the  equations  of  motion  becomes 


x = Fx  + G(u  + u£) 


which  will  yield  a feedback  configuration  as  indicated  below: 


(2-8) 


The  figure  as  indicated  above  suggests  the  classical  servo  prob- 
lem of  optimal  control  and  one  is  tempted  to  define  a performance  index 


co  T T 

u = min  f l"(x  - u ) Q(x  - u ) + u Rul  dt  (2-9) 
u ''o  L c C J 


which  would  yield  a gain  matrix  in  the  command  part  of  the  system  shown  in  the 
above  figure.  However,  the  regulator  or  feedback  part  of  the  system  is  unaf- 
fected by  the  command  input,  so  the  two  parts,  regulator  or  feedback  and  com- 
mand or  feedforward  parts  for  aircraft  probably  should  be  designed  completely 
independently  of  each  other.  The  feedforward  part  of  the  system  will  set 
static  flying  qualities  requirements  such  as  stick  force  per  "g". 

Minimization  of  an  output  or  response  variable  has  a very  definite 
meaning  in  the  optimal  context.  Every  weighted  output  or  combination  of 
state  variables  in  the  performance  index  will  have  a closed  loop  response  that 
approximates  the  response  of  a Butterworth  filter  as  the  weighting  on  the 
outputs  becomes  large  relative  to  the  weighting  on  the  control  variables. 

For  aircraft  control,  it  then  becomes  important  to  recognize  or 
define  those  motion  variables  or  time  histories  that  should  tend  to  respond 
as  a Butterworth  filter  responds,  which  is  a smooth  and  well-behaved  response 


U 
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with  little  overshoot  (5  = 0.707  for  a second  order  system).  For  an  aircraft 
it  is  quite  clear  that  this  kind  of  response  is  not  necessarily  desirable  for 
some  aircraft  motion  variables.  To  illustrate,  consider,  as  shown  in  Figure  2-1, 
the  two  performance  indices,  the  resulting  migration  of  the  closed-loop  poles 
of  the  two-degree-of-freedom  aircraft  representation  as  the  weighting  on  the 
output  variable  becomes  large  with  respect  to  the  input,  and  the  resulting  re- 
sponses of  the  aircraft  to  a pilot  step  command  input. 

As  sketched  in  Figure  2-1,  the  use  of  performance  index  (1)  will  lead 
to  a response  in  angle  of  attack  approaching  that  of  a second  order  Butterworth 
filter  while  the  use  of  performance  index  (2)  will  lead  to  a first  order  Butter- 
worth  filter  response  in  pitch  rate  as  the  ratio  q/r  becomes  large.  There- 
fore, a flight  augmentation  system  designed  on  the  basis  of  the  first  perfor- 
mance index  will  enable  the  pilot  to  change  the  angle  of  attack  of  his  air- 
craft lapidly  and  smoothly  by  a step  stick  input,  allowing  for  enhanced  air- 
craft maneuverability.  The  second  performance  index  will  yield  an  aircraft 
that  maneuvers  sluggishly  but  allows  for  rapid  and  precise  pitch  rate  and 
therefore  attitude  angle  control. 


The  phenomena  is  easily  explained  on  the  basis  of  the  differences 
between  the  locations  of  the  zeros  of  the  «/Ve(s)  and  the  Q//e(s)  transfer 
functions.  These  transfer  function  zeros  are  fixed  if  feedback  is  provided 
for  only  one  control  surface,  in  this  case  the  elevator.  These  zeros  act,  in 
the  cases  of  Figure  2-1,  as  transmission  zeros.  For  the  performance  index  (2), 
the  transmission  zero  is  at  L^;  for  the  performance  index  (1),  the  transmis- 
sion zero  is  at  oo  (assuming  zero  L . ).  Therefore,  a performance  index  con- 
's 

taining  positive  value  weighting  measures  of  both  a(t)  and  9(t)  may  have  a 
transmission  zero  anywhere  on  the  negative  real  axis  to  the  left  of  La  . But 
because  the  transfer  function  zeros  cannot  be  altered,  the  response  of  the 
aircraft  will  be  bounded  by  the  two  response  sets  shown  in  Figure  2-1  and  fixed 
with  respect  to  each  other.  If  feedback  were  provided  for  multiple  inputs  as 
well  as  multiple  outputs,  the  closed-loop  transfer  function  zeros  can  be  al- 
tered and  closed-loop  dynamic  behavior  can  be  altered  much  more  freely.  There- 
fore, before  proceeding  to  the  description  of  design  methods  to  predict  and 


to  place  the  zeros  of  closed-loop  transfer  functions  for  optimal  systems,  a 
general  discussion  of  zeros  of  linear  systems  is  presented  first. 


Zeros 

The  basic  small  perturbation,  linearized  equations  of  motion  of 
an  aircraft  are  usually  described  in  the  matrix-vector  form 

Ax  Bx  + Cu  (2-10) 

or  the  state-space  form 

x = Fx  + Gu  (2-11) 

where,  of  course,  F = A ^B  and  G = A ^C.  After  taking  a single-sided  Laplace 
transform,  equation  (2-11)  becomes 

sx(s)  = Fx(s)  + Gu(s)  + x(o)  (2-12) 

and  solving  for  x(s)  yields 

x (s ) = (Is-F)-1  Gu(s)  + (Is-F)"1  x(0)  (2-13) 

The  matrix  (Is-F)"*G  is  called  the  transfer-function  matrix, or  more 
accurately  the  matrix  of  transfer  functions  while  the  matrix  (Is-F)  * de- 
scribes the  output  or  state  response  to  a vector  of  initial  conditions  x(tQ)  = 

x . Consider  the  matrix  of  transfer  functions 
o 

(Is-F)”1G  = "j  Is*-  F (2-14) 

For  a system  whose  state  vector  is  of  dimension  n and  an  input 
vector  of  dimension  p,  equation  (2-14)  defines  a proper  matrix  of  transfer 
functions,  each  transfer  function  has  a numerator  polynomial  of  order  less  than 
that  of  the  denominator  polynomial.  The  matrix  adj  [ls-F]G  defines  the  zeros 
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IMP* 


1 • 


\\ 


l 


of  the  transfer  function  matrix.  Each  polynomial  entry  of  adj  |iS-f]g  defines 
zeros  of  individual  transfer  functions,  while  the  determinant  jjS-F]  defines 
the  denominator  polynomial  common  to  all  transfer  functions  and  is  called  the 
characteristic  polynomial.  For  a physical  system  such  as  an  aircraft,  the 
roots  of  the  characteristic  polynomial  are  called  the  poles  of  the  system.  By 
virtue  of  the  fact  that  it  can  be  flown,  an  aircraft  may  always  be  considered 
to  be  completely  controllable  and  observable  in  the  classical  sense. 

Transmission  Zeros 


The  matrix  of  transfer  functions  defined  by  Equation  (2-14)  can  be 


written  as 


(Is-F)-1G  = 


I Is-F| 


N11  N12 


21 

I 

I 


nl‘ 


np 


N(s) 

d(s) 


(2-15) 


The  determinant  of  each  non-singular  minor  of  the  matrix  N(s)  defines 
zeros  of  the  transfer  function  matrix  that  can  be  different  from  the  zeros  of 
individual  transfer  functions  or  roots  of  each  element  of  N(s).  For  instance, 
a second  minor  of  N(s)  is  given  by 


N 

N 


21 

41 


00 

(S) 


N,,(s) 


D(s)  L2,4(s)  (2-16) 

1,3 


2 4 

where  the  notation  L ' is  used  to  indicate  that  all  rows  except  2 and  4 have 

1,0 

been  deleted  (upper  index)  and  all  columns  except  1 and  3 (lower  index)  have 
been  deleted.  These  zeros,  originally  called  coupling  zeros  (References  4,  5 ) 
play  an  important  role  in  the  feedback  design  of  multicontroller  systems  just 
as  the  zeros  of  transfer  functions  are  important  to  single  input  control  sys- 
tem designs. 


j 
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The  largest  order  non-singular  minors  of  N(s),  normally  of  dimension 
pxp,  define  the  transmission  zeros  of  the  multivariable  system.  A pxp  minor 
of  N(s),  called  a pt^1  minor,  is  defined  as 

p-1  any  p rows 

t(s)  = (D(s)j  L(s)  (2-17) 

1,2,  a • «P 

A combination  of  the  zeros  of  the  (n-p)**1  order  polynomials 

any  p rows 

L(s)  defined  by  Equation  (2-8)  are  called  transmission  zeros  of  the  sys- 

1 , 2, • • .p 

tem  and  are  invariant  with  feedback.  These  transmission  zeros  define,  in  gen- 
eral, the  terminal  or  high  feedback  gain  limiting  locations  of  n-p  closed-loop 
poles  and  the  zeros,  including  both  transfer  function  zeros  (first  minors  of 
N(s))  and  all  other  zeros  as  well  (2nc*  to  (p-l)**1  minors  of  N(s)). 

Therefore,  a system  that  has  as  many  outputs  as  inputs,  i.e. 

x = Fx  + Gu  (2-18a) 

y = Hx  (2-18b) 

where  u is  an  input  vector  of  dimension  p and  y is  an  output  vector  of  dimen- 
sion p,  will  have  a square  transfer  function  matrix  N(s).  The  determinant  of 

N(s),  | N (s) | , is  given  by  . , 

N(s)|  = H [is  - F]'1  G 

p-1  l,....p 

D(s  )f  • L(s)  (2-19) 

1.....P 

and  will  be  the  only  term  defining  the  system  transmission  zeros.  If  G and  H 
are  square  and  nonsingular,  then  L(s)  is  a constant  and  there  are  no  finite 
transmission  zeros.  In  this  case,  poles  and  possibly  some  transfer  function 
zeros  can  be  placed  anywhere  with  feedback. 

The  transmission  zeros  of  a single  controller  system  are  then  the 
zeros  of  the  output  of  the  system.  If  only  one  measurement  of  the  system  dyna- 
mics is  used  for  feedback,  then  the  transmission  zeros  are  the  transfer  func- 
tion zeros  of  that  measurement.  If  two  or  more  outputs  are  used  for  feedback, 
as 
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U1  ■ kl  * k2  y2 
then  the  control  law  can  be  written  as 

u * ki  h * (17)  H =ki? 

and  the  transmission  zeros  are  obtained  from  the  numerator  polynomial  of  trans- 
fer function  of  the  equivalent  output 

k„ 

(2-20) 


- y (s)  ♦ 2/k.  y (s) 

L (s)  = 1 1 l 


u(s) 

Zeros,  then,  are  as  important  to  the  design  of  a feedback  control 
system  as  the  poles  of  the  system.  As  an  example  of  the  effect  of  transmission 
zeros  on  the  closed  loop  poles  and  transfer  function  zeros  of  a multivariable 
system,  consider  the  two-input,  three  output  system  schematically  shown  in 
Figure  2-2  below. 


given  by 


Fig.  2-2  GENERALIZED  2 INPUT,  3 OUTPUT  SYSTEM 
From  the  figure,  it  can  be  seen  that  the  feedback  control  law  is 
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ii 


(2-21) 


y2 
y3 

so  each  of  the  outputs  is  fed  back  into  both  inputs.  Using  the  rules  of  sig- 
nal flow  theory,  the  closed  loop  characteristic  polynomial  can  be  expressed  as 


1 

H 

3 

kll 

k12 

1 

to 

H 

1 

c 

N> 

1 

> 

k22 

k23 

&(s)  = D(s)  - kn  Nn(s)  - k22  N22(s)  - kJ2  N21(s)  - k21  N12(s)  - k13  N31(s) 


12, 


13, 


_k23  N32(S)  + <kn  k”  ' ki?  koi>  LTW  + (*n  - k,,  k,,)  L“(.) 


11  22  12  21''  12  ’ 


.23, 


* ^k22  k13  - k12  k23>  LuM 


11  23  13  21  “12 1 

(2-22) 


or,  using  the  notation  K ^ to  indicate  the  minor  of  the  feedback  gain  matrix 
that  retains  the  a,  b rows  and  c,  d columns.  Equation  (2-22)  can  be  written 


&Cs)  - D(s)  - ku  Nu(s)  - k22  N22(s)  - k12  N21(s)  - k21  N12(s)  - k13  N31(s) 


•k23  N32<S>  + L12 ^ + Kl3  L\l^  + K23 


(2-23) 


The  transmission  zeros  for  the  closed  loop  poles  are  defined  from 
the  expression  T(s)  - kj2  lJ2(s)  + kj2  lJ2(s)  + K*2  L^(s)  and  the  zeros 
defined  by  L*2(s),  L*2(s)  anc*  k22(s)  are  ca^e<*  invariant  zeros  of  the  system 
which  cannot  be  changed  by  feedback. 


A closed  loop  transfer  function  numerator  polynomial, 
can  be  obtained  by  inspection  also  using  signal  flow  methods 


say  N (s), 
llCJL 


N11  (s)  s NllCs)  " k22  L12(S)  • k23  L12(S)  (2_24) 

which  shows  how  the  transfer  function  zeros  vary  as  a function  of  the  second 
minors  of  the  transfer  function  matrix  and  the  feedback  gains  from  other  out- 
puts to  other  inputs,  in  this  case  the  feedback  from  outputs  2 and  3 to  input  2. 
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Equation  (2-24)  can  be  expressed  in  the  classical  root  locus  form 


to  obtain  the  closed-loop  zeros  as 


0 = 1 


l«W 

22  Nn(s) 


L^Cs) 


(2-25) 


which  shows  that  two  separate  but  consecutive  root  locus  plots,  one  involving 
^23 

the  parameter  ^ — and  the  other  involving  k^2  are  required  to  design  for  a 
specific  closed-loop  transfer  function  set  of  zeros.  Equation  (2-25)  shows 
that  for  a fixed  ratio  the  transmission  zeros  for  the  numerator  polynomial 
^(s)  are  obtained  the  roots  of  the  polynomial  (s)  ♦ k^^  ^^(s)  = 

Unfortunately,  the  expressions  for  the  definition  of  closed-loop 
zeros  of  transfer  functions  of  linear  systems  designed  using  linear  optimal 
control  methods  are  not  obtainable  as  easily  as  indicated  above,  but  progress 
leading  to  these  design  aids  has  been  made.  This  progress  has  been  described 
in  the  following  section. 


i 


Section  3 

OPTIMAL  CONTROL  SYSTEMS  DESIGN  PROCEDURES 
3.1  GENERAL  PROBLEM 

The  linear  optimal  control  problem  as  given  in  Section  2 is  summar- 
ized here  briefly. 

Linear  optimal  control,  as  generally  applied  to  aircraft,  involves 
the  minimization  of  a quadratic  form  of  scalar  performance  index 

Oo 

j a i / cyTy + u Ru)dt  (3-d 

o 

Subject  to  the  constraint  of  the  familiar  linearized,  small  perturbation  equa- 
tions of  aircraft  motion 
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PF  + ftp  - pgr_1gtp  + htqh  = o 


(3-5) 


After  taking  the  single-sided  Laplace  transform  of  Equation  (3-3) , 
the  result  is 


-1  T 
GR  V 


-sI-F 


x(0) 

-p(0) 


The  characteristic  equation  of  the  closed-loop  set  of  Equations 
(3-6)  is  given  by  the  determinant  expression 


<M-s)  A(s) 


sI-F 

-1  T 
GR  V 

-Q 

T 

-sI-F 

defines 

the  locus 

given  by  the  well  k 

2. 

fT1  q [ 

si  - f] 

(3-7) 


(3-8) 


The  feedback  gain  matrix  K required  to  obtain  the  closed-loop  dy- 
namics is  given  by 

-l  T 
K = -R  VP 

and  the  optimal  closed-loop  system  becomes 

x = (F  - GK)  x ♦ Gu  (3-9) 


uc  is  the  command  input. 


The  characteristic  equation  of  the  optimal  system  is  given  by 
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.si  - F + GK  = 0 


(3-10) 


and  the  closed-loop  transfer  functions  are  given  by 

adj  [sl-F+GK]  G uc(s) 
x(s)  = | si  - F + GK  | 


= W(s)  uc(s) 


(3-11) 


From  Equation  (3-6)  the  optimal  state  and  costate  are  given  by 


-1  T 
GR  G 


-sI-F 


= adj 


-I  T 
GR  V 


-p(0) 


A (s)  A(-s)  (3-12) 

To  get  the  closed-loop  transfer  functions  from  Equation  (3-12),  the 
state  and  the  costate  have  to  be  separated  either  through  spectral  factoriza- 
tion or  through  the  Riccati  solution.  Once  the  states  and  costates  are  separ- 
ated, the  problem  then  is  to  relate  the  closed-loop  transfer  functions  to  the 
performance  index  matrices.  In  this  section,  two  sequential  design  procedures 
will  be  described  which  determine  pole-zero  movements  of  the  transfer  functions 
as  the  weighting  matrix  on  the  states  is  varied  for  a given  weighting  matrix 
on  the  control. 

3.2  SEPARATION  OF  STATE  AND  COSTATE 


The  solution  of  the  linear  optimal  control  problem  requires  the 
solution  of  Euler-Lagrange  equations  (Hamiltonian  Equations) 


-GR-1GT  1 fx(t) 


x(t)  x(t) 

= Ji 

P(t)  p(t) 


(3-13) 
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Following  the  development  given  in  Reference  7,  Equation  (3-13) 
can  be  transformed  into  the  diagonal  form  by  the  transformation 


where  the  matrix 


T T 

11  12 


T T 

21  22 


T T 

11  12 


T T 

21  22 


(3-14) 


is  a 2nx2n  matrix  of  eigenvectors  and  can  be  found  from 

[si  -X] T.  I = 0 


(3-15) 


where  s.  is  the  it^  eigenvalue  of  the  optimal  system  and  its  adjoint  and  T.  is 
the  i eigenvector  of  the  dynamic  matrix 


The  solution  in  the  transformed  domain  is  given  by 

• — i r*  -T 1 ■>  1 •— 


“-viK.  Ti2lU 


T21  T22  I I h 


(5-16) 


The  response  can  then  be  written 

.At 


J2Ct) 


0 

--At 


"^(0)' 

J 

1 

t — \ 

o 

v_y 

» 

(3-17) 


or 


'x(t)' 

"t 

11 

T 

12 

P(t) 

T 

*21 

T 

22 

-1 


reAt  o 


n .-At 

o e. 

Let  the  inverse  of  the  transformation  matrix  be 


T T 
11  12 


T T 

21  22 


”x(0)  " 

P(0) 

(3-18) 


T 

*11 

T 

12 

S 

" K 

L ' 

T 

. 21 

T 

22  _ 

M 

N 

(3-19) 


then 


x(t)" 

P(t) 

T T 

11  12 


T T 
21  22 


e.At  0 


.-At 


K 

L " 

'x(O) " 

M 

N 

P(0) 

(3-20) 


from  which  x(t)  can  be  obtained  as 

x (t)  = Tn  Kx(0>  Tn€AtL  p(0)  + TJ2  M x(0)  + T17e'At  N pCO) 
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(3-21) 


The  optimal  solution  for  x(t),  which  is  stable,  cannot  contain 
terms  in  <£  Therefore,  x(0)  and  p(0)  must  be  related  by  the  expression 


P CO)  * -N-1  M x(0) 


(3-22) 
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The  optimal  solution  now  is  given  by 


U 


x(t)  = Tn<2At  (K  - LN-1M)  x(0) 


(3-23) 


From  the  identity 


T T 

11  12 


T T 
21  22 


K L 

M N 


K L 

M N 


T T 
11  12 


T T 
21  22 


(3-24) 


the  following  relationships  can  be  obtained 


M " “^21  Tn1 


K = -LT22  T12j 


N = CT22  " T21  T11  T12 1 L =[T21  " T22  T12 


L _ ~“1  ’ -_1 
l22  ‘21  ‘11  T 

(3-25) 

Substituting  these  expressions  for  K,  L,  M,  and  N,  the  optimal  solution  is 
given  by 


x(t)  = TneM  T^1  x(0) 


(3-26) 


The  closed-loop  transfer  functions  are  given  by 

x(s)  = Tu  [si  -A]"1  T^1  G uc(s) 


(3-27) 


Therefore,  once  the  eigenvectors  of  the  Hamiltonian  system  of 
Equations  (3-13)  are  determined,  the  feedback  control  law  can  be  computed 
directly.  The  solution  of  the  Riccati  equation  is  given  by 


P = T T 
21  11 


(3-28) 


21 


A 


i 


and  the  feedback  control  law  is  given  by 


-1  T -1 

u =*  -R  G T T 1 x 


(3-29) 


Equation  (3-27)  shows  that  the  closed-loop  transfer  functions  are 
directly  related  to  the  eigenvalues,  eigenvectors  and  control  matrix  G of  the 
system.  These  eigenvalues  and  eigenvectors  are  a function  of  the  weighting  ma- 
trices Q and  R in  the  performance  index.  A functional  relationship  between  Q, 

R and  the  eigenvector  matrix  would  be  very  useful  in  the  selection  of  performance 
indices  for  multicontroller  linear  optimal  control  systems. 

The  first  n columns  of  the  matrix  of  eigenvectors 


T 1 T 
11  I 12 


T 1 T 

21  i 22 


are  the  eigenvectors  corresponding  to  the  left  half  plane  eigenvalues  and  the 
last  n columns  are  the  eigenvectors  corresponding  to  the  right  half  plane 
eigenvalues.  Let  the  2nxl  vector 


(3-50) 


t„ 


where  t^  and  t^  are  nxl  vectors,  represent  the  closed-loop  eigenvectors  of 

the  Hamiltonian  matrix  and  let  /u.  represent  the  closed-loop  eigenvalue.  It 

/ 

follows  that 


-1  T 
-GR  G 


(3-31) 


U 


-1  „T\ 


Solving  for  t2  we  get 


Ftj  - GR  G t2  = JJ- 
-Qt  - FTt  = /*t 


t,  = [ -/.  i - F1]-1  Qtx 


(3-32) 


(3-33) 


Substituting  for  t2  we  get 


| F - GR-1  GT  [-  /m  I - FT]  1 Q } tj  - /* t2  (3-34) 

If  from  Equation  (3-34) , the  optimal  e.losed-loop  eigenvectors  can  be  determined 
as  a function  of  the  weighting  matrices  of  the  performance  index,  then  the 
closed-loop  transfer  functions  can  be  determined  as  a function  of  the  weighting 


matrices. 


Another  way  of  separating  the  states  and  costates  is  to  find  the  ma- 
trix P which  relates  states  and  costates. 

In  Reference  1,  Whitbeck  describes  a conceptual  solution  to  the  lin- 
ear optimal  control  problem  without  recourse  to  the  steady-state  Riccati  equa- 
tion 

PF  + PFT  + Q - PGR-1  GT  P = 0 

The  problem  is  that  of  finding  the  set  of  numbers  which  define  the 
adjoint  or  costate  vector  p at  time  zero.  After  taking  the  Laplace  transform 
of  the  Hamiltonian  equations,  the  solution  in  the  Laplace  domain  is  given  by 


x(s)l  fsl  - F GR"1  GT 


-si  - F*  -p(0) 


(3-35) 


-p(0) 


(3-36) 


where 


The  elements  of  the  matrix  B are  polynomials  in  s.  Any  component 
of  the  state  vector,  say, for  example,  x^s)  can  be  written  as 

x1(s)  = bll  xl(Q)  * bl2  x2(0)  * •••*  bln  xn(0:) 

A(s)  A(-s) 

+ bln+l  P1W  * bln+2  P2W  * ••••  b12n  VQ) 


A(s)  A(-s) 


(3-41) 


where  b^(s),  j » 1,  2,..,.  2n,  represent  the  elements  in  the  first  row  of 

the  B matrix.  If  the  optimal  solution  x^s)  is  to  represent  a stable  component 

of  the  closed-loop  state  vector,  then  p.(0),....p  (0)  must  be  such  that  A(-s) 

1 n 

cancels  identically  into  the  numerator  of  Equation  (3-40).  The  numerator  of 
Equation  (3-40)  must  equal  zero  for  those  values  of  s such  that  A(-s)  = 0.  The 
values  ef  s which  make  A(-s)  = 0 are  the  right  half  plane  eigenvalues  and 
n linear  equations  in  n unknowns  are  obtained  relating  x(0)  to  p(0)  when  s takes 
on  these  values.  By  solving  these  linear  equations  p(0)  may  be  expressed  in 
terms  of  x(0)  as 


P(0)  = Px(0) 


where  P must  be  identically  equal  to  the  positive  semi-definite  solution 
of  the  steady-state  Riccati  equation. 

The  n linear  equations  in  n unknowns  were  obtained  by  evaluating 
the  numerator  of  one  component  of  the  state  vector  at  the  right  half  eigen- 
values. The  same  set  of  equations  can  be  obtained  by  evaluating  the  numerator 
of  each  component  of  the  state  vector  at  a right  half  plane  eigenvalue.  The 
state  vector  is  given  by 

x(s)  * B1  x(0)  - B2  p(0)  (3-42) 
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The  n linear  equations  relating  the  x(0)  and  p(0)  may  be  obtained 
by  evaluating  each  row  of  the  matrices  and  at  a right  half  plane 

eigenvalue.  The  matrix  P is  given  by 


P ■ B2_1  B1 


i = 1,  2,  ...  n 


(3-43) 


where  s^  are  the  right  half  plane  eigenvalues. 

The  matrices  and  are  functions  of  Q and  R.  The  closed-loop  transfer 
functions  are  given  by 


x(s)  = [Bj  - B2  P]  G uc(s) 


(3-44) 


An  example  is  given  to  illustrate  the  concept  involved.  In  the 
example  considered  in  Reference  1 


0 1 


-2  -3 


1 0 


0 1 


0 0 


0 5 


0 4 


(3-45) 


The  Hamiltonian  matrix,  after  taking  the  Laplace  transform,  becomes 


f.I 


(3-46) 


By  inverting  the  matrix  [si  ~M\  , the  first  component  of  the 

state  vector  x^(s)  is  obtained  and  the  set  of  linear  equations  relating  x(0) 
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and  p(0)  can  be  obtained  by  evaluating  the  numerators  of  x^s)  at  the  closed- 
loop  right  half  plane  eigenvalues,  s = 3 and  s - 4 yielding  the  following  set 
of  equations 


U 


? -3 


Px(0) 


P,(0) 


xx(0) 


x2(0) 


(3-47) 


The  same  set  of  linear  equations  (3-47)  can  be  obtained  by  substi- 
tuting s = 3 in  the  numerator  of  x^s)  and  s - 4 in  the  numerator  of  x2(s). 

The  adjoint  of  [si  - X]  is  given  by 


adj  [si  - XJ 


s3  - 

27s 

+ 6 

2 

s - 

3s  + 

72 

7s2  - 207 

18s  + 42 

= 

♦ 

N . 
</» 
<N| 

1 

6s 

- 4 

3 

s 

3s2+ 

2s 

-18s  + 42 

4s2  - 28 

1 

10 

-10s 

-s3+27s+6s 

-4s2-6s-4 

10s 

-5  s2 

s2+3s+72 

3 2 , 

-s  -3s  -2 

(3-48) 


Substitution  of  s = 3 in  the  first  row  of  the  matrix  adj  £sl  - 
and  s = 4 in  the  second  row  yields  the  same  set  of  equations  (3-47)  and 


PiCO) 


P2(0) 


.25  -.125 

-.125  .5625 


1 

0 

' — t 

rH 

X 

1  

1 

X 

N> 

t — \ 

o 

1 

= P x(0) 


(3-49) 


3.3 


SEQUENTIAL  DESIGN  PROCEDURES 


A design  procedure  has  been  developed  by  Solheim  (Reference  2)  that 
finds  the  elements  of  the  weighting  matrix  of  a performance  index  that  corres- 
pond to  the  given  poles.  With  a given  control  weighting  matrix  R,  the  procedure 
enables  the  determination  of  a Q matrix  so  that  the  closed-loop  system  has 
prescribed  eigenvalues.  The  procedure  is  sequential  so  that  only  one  pole 
is  moved  at  a time.  A performance  index  matrix  Q is  determined  so  that  only 
one  pole  changes.  Each  time  a pole  is  moved,  a performance  index  matrix  Q 
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is  determined  that  corresponds  to  the  change  in  the  pole  location.  Finally, 
all  the  different  weighting  matrices  are  added  together  to  yield  one  weight- 
ing matrix  that  corresponds  to  prescribed  closed-loop  pole  locations.  The  proce- 
dure for  pole  placement  with  distinct  real  poles  is  described  briefly  below. 

3.3.1  Pole  Placement 


The  system  of  equations  (3-1)  is  transformed  into  the  Jordan  form 
with  the  transformation  x = Tjj.  yielding  the  equation 

j = T"1  Gu  (3-50) 

where  .A  is  assumed  to  be  a diagonal  matrix  because  the  multiple  eigenvalue  (3-2a) 
problem  does  not  normally  exist  for  a finite  time  in  the  aircraft  control  problem. 


The  performance  index  (3-2a)  can  be  expressed  in  terms  of  the  trans- 
formed state  vector  ^ : 

J = j f (/  TT  + uT  Ru)  dt 
0 

oo 

- J / (/  Q?  + UT  Ru)  dt  (3-51) 

o 

~ t 

where  Q = T QT 

The  value  of  the  performance  index  J is  same  as  before.  Selection  of  a Q matrix 
will  determine  a Q matrix  through  the  transformation  matrix  T keeping  the  value 
of  J the  same  under  transformation. 


The  Hamiltonian  set  of  equations  are  now  given  by 


> 

A -C 

> 

V 

> 

= 

= 

_ p 

_-Q  -A  _ 

_P  _ 

.p 

-1  -1  T -T  -T 

where  C = T GR  G T and  T is  the  inverse  of  the  transpose. 


(3-52) 


The  linear  optimal  control  law  is  given  by 

-1  T -T  ~ 

u » -R  G1  T P (3-53) 

where  P is  the  appropriate  Riccati  solution. 
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The  eigenvalues  of  .K  and  Jtare  identical  and  are  given  by  the  characteristic 
equation 


|si  -X\  = o 

using  the  expression  as  given  (Reference  2) : 


(3-54) 


O 

1 

’ si  - A C 

II 

£ 

1 

1 1 

./ 

-Q  [si  -X]"1  I 

0 si  +A  - Q [si  - A]  C 

The  characteristic  equation  is  obtained  as 

| si  -jf|  - |sI-A||sI+A  - Q [si  -A]-1  C | (3-55) 


If  only  one  element  of  the  matrix  Q is  non-zero,  namely  q^,  the 


second  determinant  on  the  right-hand  side  of  (3-55)  becomes 

s+  A _ 


si  +A  - Q [si  - A]'1  C 


0 

s+  A . 


0 

0 


i 


~qJXCji 


i -hfjr, 

S-Ai 


- Aj 


I 


s+  A 


n 

(3-56) 


The  characteristic  equation  may  then  be  written  as 

w.-^l  . £(.-»,)  [(•  * «„)  £<*♦»!>] 


i^j 


r n n 

(s  ♦ A.)(5  - A.)  -q^Cjj  n (s  ♦ A.)(S  - A.)  = 0 
L J 1*1  r 


(3-57) 
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where  are  the  open  loop  eigenvalues.  The  eigenvalues  of  the  matrix  are 


»i  s - *i  i f j,  i = 1,  2,  ...  n ] 


s . = 1 Ja2  + q.  . C.  . 

i V j hjj  n 


(3-58) 


-th 


If  the  j closed-loop  eigenvalue  s^  is  to  be  specified  can 


be  determined  from  the  above  equation 

q 


sf  - V 
= .J L 


(3-59) 


JJ 


The  optimal  control  law  is  given  by 


-1  T -T  — -1  T -T  X - -i 

u » -R  G T p = -R  1 G T = K T x (3-60) 


where  K is  the  optimal  feedback  gain  in  the  transformed  domain  and  the  P is  the 
solution  of  the  Riccati  equation 


PA  + A P + Q - P T"1  GR'1  GT  T~T  P = 0 


(3-61) 


In  the  optimal  feedback  system 


x = [F  + GK] 


(3-62) 


where 

K = lO’"1 

One  pole  of  the  open-loop  system  has  been  shifted  to  a specified 
location.  Starting  with  the  new  system  F * (j  + Gk]  , a performance  index  Q 
can  be  determined  to  shift  the  next  pole.  And  in  this  sequential  manner  a 
weighting  matrix  Q can  be  determined  to  shift  each  pole  and  these  different 
weighting  matrices  may  be  added  together  to  get  one  weighting  matrix  which  would 
shift  all  the  eigenvalues  to  their  specified  locations.  The  procedure  described 
here  is  applicable  for  systems  with  real  distinct  poles.  If  the  system 
has  complex  poles,  then,  as  stated  in  Reference  2,  the  system  of  equations  can 
be  transformed  to  the  block  diagonal  form  and  some  constraining  equations  have 
to  be  satisfied  to  shift  the  complex  poles. 
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This  sequential  procedure  for  pole  placement  is  extended  to  the  de- 
termination of  the  movement  of  the  zeros  at  each  stage  as  the  matrix  Q is  varied 
Two  sequential  procedures,  one  computing  the  Riccati  solution  from  a set  of  lin- 
ear equations  and  the  other  computing  the  closed-loop  eigenvectors,  are  pre- 
sented in  the  following  that  determine  the  pole-zero  movements  as  Q is  varied 
for  a given  R matrix. 


3.3.2 


Design  Procedure  1 


This  procedure  is  based  upon  obtaining  the  Riccati  solution  from  a 
set  of  linear  equations  as  described  above.  The  procedure  is  applicable  for 
systems  with  real  distinct  poles.  For  systems  with  complex  poles,  as  stated 
above,  some  constraining  equations  have  to  be  satisfied.  To  determine  the 
movement  of  the  zeros,  the  inverse  of  the  matrix  [sl->fl  is  required.  From 
Equation  (3-54a) , the  inverse  can  be  written  as 


ox-xy 


sI-A 


0 sI+A-Q[sI-A]  C -Q[sl-A]  I 


where  the  matrices  are  given  by 


Ax  = [sI-A]”1  + [sI-A]-1  C (sI+A  -Q  [sI-A]_1  c|  1 Q [sI-A]-1 

A2  = - [si -A]-1  C ^SI+A  -Q  [si -A]-1  cf 
A,  = - ^sI+A  -Q[sl-A]_1  cj  Q[sI-A]-1 


(3-63) 


The  matrices  can  be  expressed  in  closed  form  in  terms  of  the  weight- 
ing matrix  elements.  To  get  the  matrices  Ai  in  closed  form,  it  is  required 
to  get  the  inverse  of  the  matrix  {sI+A  -Q[sl-A]  J in  closed  form.  The 
inverse  can  be  found  from  the  technique  given  in  Appendix  A.  With  only  the 


"q. . element  in  Q being  non-zero. 


and 


where 


si  *A  - Q fsl  - A]’lc  f 


s + A, 


0 

s ♦ A, 


-q.  .C . 

JJ  J* 


~qi;.c 3?  - 
s * Aj 


S+  A . -q . .C . . 
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-q. .C. 

JJ  J?.  i 
S - A . 1 
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s ♦ A 


{si  *A  - Q si  -A*1  c) 


,-1 


s * A, 


q.  .C., 

j:.  j.1 


(s 


!uh*. 


(S  * *2)a 


S- A. 

a 


(»♦  A.  )a 
v j*l 


qiJC1n 

(s.An)a 


-Vi 


S * A 


a - fs  + A .)  (j  - A •)  - q -C. . 

i v J H33  33 


(3-65) 

(3-66) 


32 


The  matrices  and  are  needed  to  get  closed-loop  transfer  func- 


tions and  are  now  given  by 


1 

s-A, 


C.  . q. . 


a(s  - 


C„.  q. • 


a(s  - A2) 


C.  . q.  . 1 

+ T^T-  ~ “ 0 

a(s  - Aj)  J 


C . q.. 
nj 


a(s  - V 


1 

S - A 


(5-67) 


and  A2  can  be  written  as  a sum  of  two  matrices 


A2  = C1  + C2 


(3-68) 


where 


(s-A^ts-A^  (5-A1)(5+A2) 


c,,.(*-a.) 


a(s-Ax) 


(5-A1)(s+An) 


(9-A2)(s+A1) 


C. . (s-A.) 
lj  1 


a(s-A2) 


(s-A2) (s+An) 


C .(s-A.) 
nj v r 


(3-69) 


U 


c 


a(s-A,)  (s+A_)  a(s-A  ) (s+A 


) (*♦»_) 


a(5-AJ(s+AJ 


)(s+A^J 


a(s-An) (s+Aj)  a(s-An) (s+A2) 


a(s-AnH~Aj+i)  a(s-An)(s+An)J 


(3-70) 


That  part  of  the  adjoint  matrix  required  to  get  the  closed-loop 
transfer  functions  can  be  obtained  by  multiplying  the  matrices  and  A^  by 
A(s)  A(-s).  The  submatrices  and  of  the  matrix  adj  [sI-J7C]  are  given  by 


= AC*)  A(-s)  Ax 


a 7T  (s+A.)  ft  (s-A  ) 
i=l  i-1 


i^l  ,j 
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i/j  i^l>j 
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(3-73) 


The  matrices  and  B.,  are  functions  of  the  performance  index  ma- 


a *- 

trices  Q and  R.  The  closed  loop  transfer  functions  are  as  given  before: 


x(s)  = T(B1(s)  - B2(s)  P)  Guc(s) 


(3-74) 


where  P can  be  computed  as  follows: 


?=B2lBl|S.s.  Si*Ai  i,<j 


and  s^  is  defined  by  Equation  (3-66) . 


Equations  (3-66)  and  the  numerator  polynomials  of  (3-74)  determine 
the  movement  of  the  j pole  and  in  general  all  the  zeros  as  Q is  varied.  The 
Q matrix  can  be  obtained  from  Q and  starting  with  the  new  system  = [F  + GK], 
where  K is  the  feedback  gain  corresponding  to  Q,  the  procedure  is  repeated  to 
determine  the  movement  of  other  poles  and  zeros. 
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In  this  manner  the  movement  of  all  the  poles  and  zeros  can  be  determined  as  per- 
formance index  weighting  matrices  are  varied.  It  is  to  be  noted  that  if  the 
system  one  starts  with  is  an  optimal  system,  where  the  feedback  gain,  Kq,  is  the 
result  of  minimizing  a performance  index  using  a weighting  matrix  Qq  and  if  some 
of  the  poles  and  zeros  in  this  optimal  system  are  not  at  the  desired  locations, 
the  present  design  method  may  be  used  to  shift  them  to  more  desirable  locations 
and  the  performance  index  matrix  Q and  the  gain  matrix  K are  added  to  Qq  and  Kq 
to  get  the  total  Q and  K.  This  step  by  step  design  procedure  for  determining 
the  movement  of  poles  and  individual  transfer  function  zeros  is  summarized  in 
the  following  steps: 

1.  The  system  of  equations  is  transformed  into  Jordan  form  using 
the  transformation  matrix  T. 

2.  The  matrices  B1  and  B*  which  are  submatrices  of  the  matrix 

'V  * * 

adj  [sI-X]  are  obtained.  With  only  q. . being  non-zero  in  the 
matrix  Q,  the  Riccati  solution  is  determined. 

3.  Equation  (3-66)  along  with  B^  and  B0  determine  the  movement 
of  one  pole  and, in  general, all  the  zeros. 

4.  With  Q = {(q ..))  the  optimal  feedback  gain  can  be  computed 

~ 1 -i  -T~ 

as  K = - R GTPin  the  transformed  domain  or  after 

transforming  back  into  the  original  coordinates  the  feedback 

-1  T -T  - -1 

gain  can  be  computed  as  K » - R GT  PT. 

5.  The  matrix  Q in  the  original  coordinates  is  obtained  as 
Q = T‘T  Q T'1. 

6.  Starting  now  with  the  new  system  = (F-GK),  steps  1 through 
4 are  repeated  to  determine  the  movements  of  the  next  pole 
and  all  the  zeros.  The  final  Q and  K can  be  obtained  by  add- 
ing the  weighting  matrices  and  the  feedback  gains  at  differ- 
ent stages. 
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It  is  to  be  noted  that  after  all  the  poles  are  shifted  and 
the  zero  movements  determined,  if  some  pole-zero  locations  are  not 
desirable,  the  present  method  can  again  be  used  to  move  around  the 
poles  and  zeros  and  the  Q and  K matrices  can  be  added  to  previous 
Q and  K matrices  to  get  the  final  result.  An  example  will  illus- 
trate the  ideas  involved  in  the  design  procedure. 

Example 


and  the  performance  index  is  given  by 

J = J f UTQx  * uTRu)  dt 
o 

1.  The  first  step  is  to  transform  the  system  into  Jordan  or  diagonal 

form  using  the  transformation 

x = Ty 

where 


The  eigenvalues  of  F are  X^  = -1,  X^  = -2,  X^  * -3. 
The  transformed  equations  are  given  by 
> - T-1  FT-t  ♦ T*1  G 


and 

J 55  i + uT  Ru3dt 

o 

The  matrix  C = T-1  GR_1  GT  T"1,  Q = TT  QT  and  the  matrix  R was 

chosen  to  be 


and  the  matrix  C is  now  given  by 


2.  Let  the  matrix  Q be 

Ki  0 °‘ 

Q = 0 0 0 

. 0 0 0 . 

with  this  Q matrix  only  the  first  pole  will  be  shifted  and  the 
defining  expression  for  shifting  the  first  pole  is  given  by 


or 


W.  - 1)(AC  - 1)  ~ 8q  = 0 

1 1 


Bx(s)  = 


The  matrix  is  given  by 


q11(s-2)(s-3)(s+2)(s+3)(s-l) 


-6qu(s-2)(s-3)  (s+3) 
Squ(s-2)(s-3)  (s+2) 


(s: Z-l-8q11) (s-2) (s-3) (s+3) 


(s^l-8qn) 
(s-2) (s-3) (s+2) 


The  matrix  is  given  by 


B2(s)  = Cx  A(s)  A(-s)  + C2  A(s)  A(-s) 


where 


8(s+2)  (s+3)  (s-2)  (s-3)  jfj^-l-S^)  (s+2)  (s+3)  (s-3)  -|r(s2-l-8qn)  (s+2) 

(s+3) (s-2) 

CxA(s)A(-s)=  -6(s+l)  (s+3)  (s-2)  (s-3)  ^<s2-l-8qu)  (s+3)  (s-3)  ~(s2-l-8Sn) 


(s+3) (s-2) 

5(s+l)  (s+2)  (s-2)  (s-3)  ~y— (s2-l-8q11)  (s+2)  (s-3)  ^-(s2-l-8qn) 

(s+2) (s-2) 


0 (s+2)  (s+3)  (s-3) 

C^s^-s)-  0 36qn  (s+3)  (s-3) 

0 -30qu  (s-2)  (s-3) 


-7^-  (s+2)  (s+3)  (s-2) 
-30qu(s+3)(s-2) 

2Squ  (s+2)  (s-2) 


The  matrices  B^  and  B2  are  expressed  as  a function  of  q^  and  the  chosen  R.  The 
pole-zero  movements  can  be  determined  from  /\  (s),  B^s)  and  B2(s)  as  q^  is  varied. 

Suppose  it  is  required  to  move  the  first  pole  from  -1  to  -5.  From 
the  defining  expression  for  shifting  of  the  first  pole 
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Substitution  of  s = 5 in  the  first  row,  s = 2 in  the  second  row  and  s = 3 in 
the  third  of  the  matrices  yields 


B 


1|s=si  in  the  ith  row 


1344 

0 

0 


0 0 
0 0 
0 0 


s=s.  in  the 

1 .th 
i row 


2688 


-672(24-8qu 
-160 


- , 53763, , 840  ~ •,  . 6720q, 

q,,) — n nr  (24-^n)  + -nr11 


7 <3-*»ll>  - 9°°«11 


nr  (8-8qu)  * 12Sqn 


The  Riccati  solution  P is  given  by 


B2_1  B1 


s=s . in  the 

1 .th 
l row 


The  closed-loop  transfer  functions  are  given  by 


x(s) 


T[BlW  - b2(s)  p] 


AC*) 


T x G uc(s) 


where  u£  is  the  command  input  and  A(s)  is  the  characteristic  polynomial  of 


the  optimal  system. 


The  performance  index  matrix  Q corresponding  to  the  above  trans- 
fer functions  is  given  by 


-T  ~ -1 

Q = T Q T 1 


1 
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where 


3 0 0 
0 0 0 
0 0 0 


and  the  optimal  gain  matrix  K corresponding  to  Q is  given  by 


K = K T'1 


where  K is  obtained  from  P. 

Thus  far,  a performance  index  matrix  Q has  been  found  to  determine 
the  movement  of  one  pole  and  all  the  zeros. 

The  same  procedure  can  be  used  to  determine  the  movement  of  other 
poles  and  zeros  starting  with  the  new  system  matrix  F^  = F - GK.  The  performance 
index  matrix  Q and  the  gain  matrix  K can  be  added  to  the  previous  Q and  K to 
get  the  total  Q and  K. 


3.3.3 


Design  Procedure  2 


The  eigenvectors  of  the  optimal  closed-loop  system  can  be  used  to 
determine  the  movement  of  the  closed- loop  zeros  of  the  transfer  functions. 

The  development  given  here  is  for  systems  with  real  distinct  eigenvalues.  The 
system  of  equations  (3-1)  is  transformed  into  Jordan  form  anJ  the  Hamiltonian 
set  of  equations  for  the  transformed  system  is  as  given  before: 


- A p 


The  optimal  closed-loop  system  and  the  adjoint  can  again  be  trans- 
formed into  Jordan  form  with  the  transformation 


11 

V12 

21 

V22 

(3-75) 


where  are  nxn  matrices  and  the  first  n columns  of  the  matrix  V correspond 
to  the  eigenvectors  of  the  left-half  plane  eigenvalues  and  the  last  n columns 
correspond  to  the  eigenvectors  of  the  right-half  plane  eigenvalues.  The 
transformed  equations  are  given  by 


0 ? 


(3-76) 


UJ  L 0 -AJL*J 

where  is  a diagonal  matrix  of  closed-loop  eigenvalues. 

The  transfer  functions  can  be  written  as 

1±1L_  s v adj  [si  - A lvjJ  T'1  G 
V J A(S) 

and  the  transfer  functions  ux^  is  given  by 

c s' 

^ ■ "a  « 


(3-77) 


(3-78) 


where  &(s)  is  closed-loop  characteristic  polynomial  of  the  optimal  system  and 
T is  the  transformation  matrix  required  to  transform  the  system  of  equations 
(3-1)  into  Jordan  form. 
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The  eigenvectors  can  be  computed  from  the  Hamiltonian  matrix  as 

follows: 


-C 


v~ 


•A 


V' 


(3-79) 


where  Ac  is  a closed-loop  eigenvalue  and  v'  ~ jV^  • •••  V2nl]T  *s  411  e^gen" 
vector.  With  only  one  element  of  the  matrix  Q being  non-zero, the  first  eigen- 
vector can  be  obtained  from  the  following  set  of  equations 


A -C ' 

V 

V 

.11 

. 11 

= A 

-Q  -A 

V" 

C1 

IS  , 

L 2nl  _ 

L 2nlJ 

(3-80) 


where  the  eigenvalue  A1  is  changed  to  A 

1 C1 


The  above  equation  can  be  written  as 


0 

0 

A 

i 

0 

0 

0 


"C12  ~ 

’Cln 

1 

ni " 

"C22  ‘ 

- - - -C2n 

*21 

2A 

21 

”Cn2  - 

- - - -Cnn 

*nl 

II 

*nl 

0 - 

- 0 

*n  +11 

'^•n+ll 

— 

V- 0 

-A 

n 

ir 

2nl 

ir 

2nl 

(3-81) 


resulting  in  2n  linear  equations  in  2n  unknowns  of  the  elements  of  the  eigen- 
vector V'.  Each  equation  in  the  set  of  equations  (3-81)  can  be  written  indivi- 
dually as  follows 


A 

'it  „ 

- c. , 

v , , 

- C 

v*  . . . 

_ r 

v = 

^ Z'*" 

T*| 

1 

ii 

11 

n+11 

12 

n+21  **• 

**•  In 

2nl 

C1  11 

1J 

A„ 

- c 

ir 

- C„ 

It 

_ r 

ir  = 

A v 

n 

,2 

21 

21 

n+11 

22 

n+21  **• 

2n 

2nl 

C1  21 

n nl  nl  n+11  n2  n+21 


- C v = A v , 
nn  2nl  c^  nl 


- q..  V*  - A v~  = A 2/- 

M11  11  1 n+11  c,  n< 


A_  v- 
2 n+21 


A v 
Cj^  n+21 


(3-82) 


A 2A 
n 2nl 


A 2*- 
c,  2nl 


The  last  (n-1)  equations  can  be  written  as 


(A  + A ) v 
u c1  2J  n+21 


(A  + A_)  v = o 

c^  3 n+31 


(3-83) 


(A  + A ) v ' = 0 

c^  n'  2nl 


since  (A£  * A^)  t4  0 for  i = 2,  ...  n,  then  to  satisfy  the  set  of  equations  (3-83) 
j = n+2,  ...  2n  must  be  equal  to  zero.  The  element  can  be  ex- 


pressed in  terms  of  V'  as 


2/"  = . - — . 2A- 

n+11  (A,  ♦ A_  ) 11 

1 C1 


(3-84) 


Substituting  for  ^ j = n+1,  ...  2n  in  the  first  n equations  in  the  set  of 
equations  (3-82)  results  in  the  following  set  of  n equations 


A1  ’ll  * C11  ’ll 


A1  * Ac 


v*. . = A ^ . 

11  Cj  11 


*2  *5l  * C21  ’ll  ’ll  * 


An  Vn  * C„1  ’ll  **11  ■ Ac,  *1,1 


(3-85) 


The  first  equation  in  the  set  of  equations  (3-85)  can  be  written  as 


[<\  - Al)(Ac1  * V - CU  ’ll]  ’ll  ■ 0 


The  quantity  multiplying  tr  in  the  above  equation  is  identically 
equal  to  zero.  This  fact  can  be  seen  from  equation  (3-57).  The  expression 


(*  * VCs ' V - cn  ’n  ' 0 
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1 


L) 


defines  the  movement  of  the  first  pole,  Xc  > as  Tf11  is  varied.  Substitution 

of  A for  s yields  the  expression  1 

C1 


< \ * V<  \ - V - cn  ’u  ■ 0 


(3-86) 


The  element  of  the  eigenvector  can  now  be  chosen  arbitrarily.  The  ele- 
ments i = 2,  ...  n are  given  by 


y.  - 1 qH 

il  ■ (A  * A,)  CA_  " V 11 
C1  C1  1 


2A 


(3-87) 


The  closed-loop  eigenvalues  A£  , i = 2,  ...  n are  the  same  as  the  open-loop 
eigenvalues  A.,  i = 2,  ...  n.  1The  eigenvector  corresponding  to  the  eigen- 
value A can  be  computed  from  the  following  set  of  equations 
C2 


‘*1 

0 

0 

0 

-Cll 

-C12 

Cln 

1 

ro 

1 

V* 

12 

0 

1 

1 

1 

1 

*2 

0 

0 

-C21 

”C22 

C2n 

CM 

V 

22 

i 

1 

1 

i 

1 

1 

1 

0 _ 

— — 

A 

n 

-Cnl 

-Cn2 

-Cnn 

i 

i 

i 

v- 

n2 

1 

i 

1 

v - 
n2 

-*11 

— 
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0 - 

0 

V 

n+12 

II 

K) 

V 

n+12 

0 _ 
1 

1 

. — 

— 

0 

0 

1 

1 

1 

1 

CM 

1 

0 

( 

1 

i 

i 

i 

« 

0 _ 

— 

— 

0 



— — 

- A 

n 

*Sn2 

V 

2n2 

(3-88) 
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The  set  of  equations  (3-88)  can  be  written  individually  as  follows: 


A - C 7S'  -C  V" 

1 12  11  n+12  12  n+22 


\ ^22  C21  *n+12  " C22  *n+22 


„r  v*  = A 2A 
in  2n2  c2  12 


-C2n  *2„2  - \ *22 


A ja  ..  r y _ r 
n n2  nl  n+12  n2  n+22 


-Cnn  *2n2  ’ *c2  ^ 


- A 

^ = 

A 

V' 

1 

n+12 

c2 

n+12 

-*2 

1 

1 

1 

y*  = 

n+22 

A 

C2 

^n+22 

1 

1 

I 

. A 

ir  „ = 

A 

V 

n 

2n2 

C2 

2n2 

(3-89) 


The  elements  * = n+^’  ••••  2n  should  be  equal  to  zero  to 

satisfy  the  set  of  equations  (3-89).  The  element  v is  given  by 


S.-ll *12 

A + A, 
c2  1 


Substitution  of  in  the  first  equation  of  the  set  of  equations  (3-89) 

yields 


*1  *12  * Cn  — -Va,~  *12  * Ac,  *12 

C2  1 2 


V'*c  * V -CH%l]  *12  * ^ 


(3-90) 


I 

i 

l 

1 

I 

I 

1 


Since  is  the  same  as  the  open-loop  eigenvalue  A2,  the  quantity 
multiplying  t£2  equation  (3-90)  cannot  be  equal  to  zero.  Therefore,  to  sat- 
isfy equation  (3-90)  must  equal  zero.  From  the  second  equation  of  the  set 
of  equation  (3-89)  it  follows  that 


A„  z*r„  = A 
2 22  c2  22 


and  hence  t^2  can  be  arbitrary. 

The  elements  of  the  eigenvector  corresponding  to  the  eigenvalue  A are  now 

c2 

given  by 


*12  ■ 0,  i - 1,  ...,2n,  i + 2 


(3-91) 


In  a very  similar  manner,  the  elements  of  the  eigenvectors  cor- 
responding to  the  remaining  eigenvalues  can  be  obtained  and  are  given  by 


ir.  . = 0,  i jt  i 
ij  J 

= arbitrary  value  i=j 


i = 1,  ...,  2n 
j ~ 1,  ...,  2n 


(3-92) 


Setting  the  elements  of  the  eigenvector  which  are  arbitrary  to  1, 
the  eigenvector  matrix  is  given  by 


11 


a. 

o 

i 

i 


i 

a 


0 

1 

0 


0 

0 


(3-93) 


where 


a.  = 
l 


Cil  <11 


(Ac  ♦*.)(*.  - A) 

C1  1 C1  1 


i = 2,  ...,  n 


(3-94) 
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From  Appendix  B,  the  inverse  of  V ^ can  be  written  as 


1 0 

-a2  1 

-a3  0 

I I 

I ' 

i i 

i i 

-a  0 

n 


The  closed-loop  transfer  functions,  (s),  are  now  given  by 


^ 9s Y = V r,i  -aI’1  V7}  G. 
u (s)  11  L cj  11  i 


where 


T G and  ^ = T, 


Ac  = 


(3-95) 


(3-96) 


and  the  open-loop  eigenvalue  is  changed  to  A£  and  i = 2,....,  n. 

The  inverse  of  the  matrix  [si  -ACJ  can  be  written  as 


ir  (s-a  ) 

i=l  ci 


[si  -AJ 


7T  (a-A  ) 
i=l  ci 


(3-97) 


TT  (a-  A ) 
i=l  Ci 
i/n 
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Equation  (3-86)  along  with  the  polynomials  b^  and  the  eigenvector 
elements  a^  determine  the  movement  of  the  first  pole  and  all  the  zeros.  The 
performance  index  matrix  Q and  the  corresponding  gain  matrix  K can  be  obtained 
from 


-T  - -1 

Q = T Q T 

K = K T"1 

where  K is  gain  matrix  corresponding  to  Q. 


(3-100) 


Starting  now  with  the  new  system  = F - GK,  where  K is  the  gain 
matrix  associated  with  the  performance  index  matrix  Q,  the  movement  of  other 
poles  and  zeros  can  be  determined.  The  procedure  is  summarized  in  the  follow- 
ing steps: 

1.  The  system  of  equations  is  transformed  into  Jordan  or  diagonal 
form  using  the  transformation  matrix  T^. 

2.  With  only  the  element  of  the  matrix  Q1  being  non-zero, 
the  matrix  V ^ is  determined. 

3.  Equation  (3-86)  along  with  the  matrix  determine  the  move- 
ment of  the  first  pole  and,  in  general,  all  the  zeros  as  q^ 
is  varied.  The  coefficients  of  the  numerator  polynomials  are 
an  explicit  function  of  q^. 

4.  The  weighting  matrix  and  the  corresponding  gain  matrix 
are  determined  from  = T^"T  Q1  T^’1  and  Kj  = Kj  Tj"1, 
respectively. 

5.  Starting  with  the  new  system  matrix,  F^  = F - GK^,  steps  1 
through  4 are  repeated  to  determine  the  movements  of  other 
poles  and  zeros  and  a new  performance  index  matrix  Q2  and 
gain  matrix  are  obtained  and  added  to  the  previous  per- 
formance index  and  gain  matrices  and  K1  to  get  the  total 
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Q = Q2  and  total  K = to  move  the  open- loop  poles 

and  zeros  to  the  closed-loop  locations  determined  by  Q and  K. 
This  procedure  is  repeated  until  all  the  poles  and  zeros  are 
moved  and  the  performance  index  and  the  gain  matrices  at  each 
stage  is  added  to  the  previous  total  to  get  total  Q and  K at 
that  stage. 

It  is  to  be  noted  that  if,  after  all  the  poles  and  zeros  are  moved, 
some  of  pole-zero  locations  are  not  desirable,  this  procedure  can  again  be  used 
to  move  the  poles  and  zeros  to  move  desirable  locations  and  the  Q and  K can  be 
added  to  previous  Q and  K to  get  the  new  Q and  K. 

In  summary,  the  pole-zero  movements  are  determined  through  the 
closed-loop  eigenvectors  as  the  performance  index  matrix  is  varied.  It  is  of 
interest  to  note  that  in  Ref.  6,  performance  index  matrices  are  constructed 
based  on  model  design  specifications.  But  the  problem  addressed  there  is  the 
characterization  of  performance  index  matrices  in  terms  of  asymptotic  eigen- 
values and  eigenvectors, 

A simple  example  will  illustrate  the  ideas  involved.  The  example 
is  the  same  one  as  given  before. 


Example 


The  F and  G matrices  are  as  given  before 


o 

M 

O 

1 

1 0 

F = 

3 0 2 

G = 

1 0 

-12  -7  -6 

0 1 

1.  With  the  transformation  matrix 


1 2 1 

-1  -4  -3 

-1  1 3 


The  system  is  transformed  into  the  Jordan  or  diagonal  form 
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r 


R = 


The  defining  expression  for  shifting  the  first  pole  is  given  by 


% * V 


cn  <n  ■ 0 

<n-° 


The  eigenvector  matrix  V ^ is  given  by 


2 


2) 


28 

r. 


r„ 


m 


CA_  - DO.  * 3) 
C1  C1 


4.  The  closed- loop  transfer  functions  are  given  by 


where 


x(s)  = T Vu  [si  - Aj"1  V^1  T"1  G uc(s) 


A 


c 


0 

0 


-3 


[si  - Acr 1 


1 

= A(s) 


(s+2)  (s+3) 

0 0 

0 

(s-A  ) (s+3)  0 

C1 

0 

0 (s-A  ) (s+2) 

C1 

where  A(s)  is  the  characteristic  polynomial  of  the  optimal  system. 


Carrying  out  the  indicated  multiplications,  the  x transfer  functions  can  be 
obtained  as  explicit  functions  of  q^,  and  T2‘  The  pole-zero  movements  can 
be  determined  as  q^  is  varied  for  given  and 


If  it  is  desired  to  move  the  first  pole  from  -1  to  -5,  the  Q and 
R matrices  are  given  by 


The  eigenvector  matrix  is  given  by 


'11 


1 

-1 


7 ° 


11 


[si  - Ac] 


-1  T-1  G 


7 (s  +5s+6) 

•5  (s2+8s+1S) 
♦7 (3s+9) 


4(s^+7s+10) 
-7(f  s+S) 


s +8s+15 


s +7s+10 


T_1G 


y 
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The  x transfer  functions  can  be  obtained  by  multiplying  the  above 


I 


matrix  by  T. 

5.  The  weighting  matrix  Q can  be  computed  from  Q as 

135  27 

4 2 

75  15_ 

4 2 

li  3 

2 * 

6.  The  new  system  matrix  F is  computed  as 

F « F - GK 

where  K corresponds  to  the  weighting  matrix  Q and  the  new  system  has  poles  at 


and  the  numerator  polynomials  are  as  given  before. 


Starting  with  the  new  system  the  same  procedure  is  used  to  move 
the  other  poles  and  zeros. 


I 


Section  4 

ALTERNATIVE  DESIGN  TECHNIQUES 


In  this  section  two  alternative  design  techniques  are  presented  for 
pole-zero  placement.  In  the  first  design  technique  to  be  presented,  the  pole- 
zero  movements  are  determined  as  a function  of  the  Riccati  solution  P and  the 
weighting  matrix  R on  the  control  rather  than  as  a function  of  Q,  the  weighting 
matrix  on  the  states.  In  the  second  design  technique  to  be  presented,  the  dif- 
ferential behavior  of  the  zeros  and  poles  are  determined  under  perturbations 
in  Q and  R.  This  analysis  linearizes  the  dependence  of  the  coefficients  of 
the  numerator  and  denominator  polynomials  of  the  transfer  functions  on  the  per- 
turbations in  the  weighting  matrices  Q and  R.  This  analysis  could  be  used  as 
a basis  for  iterative  and  computational  techniques  to  study  the  behavior  of 
zeros  and  poles  as  a function  of  Q and  R. 

4.1  OPTIMAL  CONTROL  DESIGN  IN  TERMS  OF  P AND  R 

The  concern  here  is  to  generate  state  feedback  matrices  that  result 
from  a performance  index  without  solving  the  algebraic  Riccati  equation  involved. 
In  other  words,  given  the  familiar  optimal  control  problem 

x = Fx  + Gu, y = Hx 

O O 

ITT  T 

J = j / (x  Qx  + u Ru)dt 

o 

it  is  required  to  generate  all  the  possible  state  feedback  matrices  K defining 
the  optimal  control.  It  is  hoped  to  be  able  to  find  such  feedback  matrices 
without  having  to  solve  the  algebraic  Riccati  equation 

PF  + FTP  - PGR"1  GTP  + Q ■ 0 

for  P,  where  P is  needed  to  find  the  gain  matrix 

-1  T 

K = - R G P. 
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It  is  shown  here  that,  for  stable  F,  if  P is  positive  semidefinite,  then  so  is 

Q. 


Some  of  the  facts  used  to  establish  the  positive  semidefiniteness 
of  Q given  positive  semidefinite  P and  positive  definite  R are  given  in  the 
following  remarks: 


1.  If  Q is  a sum  of  two  matrices  Q.  and  Q_,  where  Q,  and  Q-,  are 
positive  definite,  then  Q is  also  positive  definite.  If  both 

and  Q2  are  positive  semidefinite,  then  so  is  Q. 

T 

2.  If  L is  a real  matrix,  then  L L is  positive  semidefinite. 

3.  Given  any  positive  definite  matrix  and  stable  F,  there 
exists  a symmetric,  positive  definite  matrix  P,  if  and  only  if, 
it  is  the  unique  solution  of  the  set  of  — P— linear  equa- 
tions 

FTP  ♦ PF  - - Qx  (4-1) 

4.  From  remark  3 it  follows  that  if  F has  eigenvalues  in  the 
left  half  plane,  then  for  any  positive  definite  P there  exists 
a unique  positive  definite  matrix  Q^. 

5.  From  the  continuity  of  the  eigenvalues  of  a matrix  as  a func- 
tion of  its  entries,  if  P of  equation  (4-1)  is  positive  semidefinite 
then  so  is  Q^. 

-IT  T -1/2 

6.  The  matrix  PGR  G P can  be  expressed  as  MM  where  M = PGR 

-1/2 

and  R is  the  inverse  of  the  positive  definite  square  root 

T 

of  R.  By  letting  MM  = Q,,  where  from  remark  2 Q0  is  positive 
semidefinite,  the  Riccati  equation  ^an  now  be  written  using 
equation  (4-1)  as 

+ Q2  * Q (4-2) 


f ] 

u 
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From  remarks  1 through  6,  it  follows  that  given  positive  definite 
matrices  P and  R and  the  F matrix  with  eigenvalues  in  the  left  half  plane, 
the  matrix  Q in  the  Riccati  equation  is  positive  definite.  If  P is  positive 
semidefinite,  so  is  Q. 

The  closed-loop  transfer  function  matrix  becomes 

W(s)  = H | si  - [f  - GR"1  GTp]}  G (4-3) 


where 

y(s)  = W(s)  uc(s) 

and  u^  is  the  command  input. 

The  closed-loop  transfer  functions  are  expressed  in  terms  of  R and 
P and  it  is  guaranteed  that  the  positive  semidefinite  P could  result  only 
from  a positive  semidefinite  Q and  hence  the  feedback  gain  matrix  K could  re- 
sult only  from  a performance  index  and  hence  optimal. 

4.2  DIFFERENTIAL  BEHAVIOR  OF  ZEROS  AND  POLES 

The  first  order  changes  in  the  individual  transfer  function  zeros 
and  system  poles  under  perturbations  in  the  performance  index  matrices  Q and  R 
are  determined.  The  perturbations  in  the  state  feedback  matrix  K under  per- 
turbations in  Q and  R are  also  determined.  Firstly,  the  effect  of  perturbing 
Q on  K is  considered. 

Perturbation  in  Q 

The  perturbation,  dP,  in  the  Riccati  solution  P is  determined  when 
Q is  perturbed  by  dQ.  From  the  Riccati  equation,  it  follows  that 

dP  [f  - GR"1  GT  p]  + [ FT  - PGR-1  GT  ] dP  = - dQ  (4-4) 
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Also  from  the  equation  defining  the  gain  matrix  K the  perturba- 
tion dK  in  K is  given  by 


dK  = -R"1  GT  dP 


(4-5) 


From  equation  (4-4)  it  follows  that 

dP  [f  + Gk]  + [fT  + KT  GT]  dP  = - dQ  (4-6) 


or 


dP  Fk  + F^  dP  = - dQ 


(4-7) 


where 


F,  = F + GK 
k 


(4-8) 


and  then  dK  is  found  from  equation  (4-5) . 


Perturbation  in  R 


The  first  order  approximation  of  ]r  + dR]  1 is  given  by 


[R  + dR] 


-1  „-l  „*1  -1 


= R - R dR  R 


(4-9) 


From  equation  (4-9)  and  the  equation  defining  K it  follows  that 


dPFk  + Fl  dP  = - KT  dR  K 


(4-10) 


Total  Perturbation  of  K 


The  total  perturbation  of  K as  a function  of  dQ  and  dR  is  then 
determined  by 


dP  Fk  + F^  dP  = - dQ  - KT  dR  K 


(4-11) 
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which  is  a linear  expression  in  dP,  and  then  dK  is  obtained  as 


dK 


R"1  [gT  dP  + dR  K 


(4-12) 


This  is  an  explicit  expression  of  dK  as  a linear  combination  of 
dQ  and  dR.  Equations  (4-11)  and  (4-12)  could  be  used  as  the  basis  of  iterative 
computational  algorithm  to  both  solve  the  Riccati  equation  and  find  the  feed- 
back matrix  K.  In  addition,  it  gives  an  insight  into  the  behavior  of  K as  a 
function  of  Q and  R. 


Effect  of  Perturbation  on  Poles  and  Zeros 


Let 


WO)  = H |]sl  - F J1  G (4-13) 

be  the  transfer  function  matrix  of  the  system  under  state  feedback  where 


F,  = F + GK 
k 


The  perturbation  transfer  function  matrix 

W(s)  + dW(s)  = H [si  - (F  + GdK)"1  _1  G 


(4-14) 


H adj  j]sl  - (Fk  + GdK)] 

“ [sI  " (Fk  + GdK)'J~] 


Since  only  the  first  order  perturbations  are  of  interest,  it  is  clear  from 
equation  (14)  that  the  coefficients  of  all  the  polynomials  in  W(s)  are  per- 
turbed linearly  by  the  different  entries  of  dK. 


A study  of  the  differential  behavior  of  K as  a function  of  Q and 
R has  been  presented.  This  study  leads  to  linear  explicit  expressions  of  dK 
and  also  shows  the  behavior  of  individual  transfer  function  zeros  and  system 
poles  as  a result  of  perturbation  in  Q and  R. 


j ui 
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Section  5 

CONTROL  SYSTEMS  DESIGN 


In  this  section  a control  systems  design  is  presented  using  the 
X-22A  V/STOL  airplane  as  the  model.  The  first  design  procedure  presented  in 
Section  3 is  used  for  the  control  systems  design. 

5.1  MATHEMATICAL  MODEL 

The  small  perturbation  longitudinal  linearized  equations  of  motion 
can  be  represented  in  a general  form  as 

x = Fx  + Gu  (1) 

with 


fAul 


Au  = u - u , Aw  = w - w , Aq  = q - q and  A0  = 9-0  where  u , w , q 

o o o o o o no 

and  9 are  reference  values  and 
o 

u - velocity  along  body  x-axis  (ft/sec) 

w - velocity  along  body  z-axis  (ft/sec) 

q - body  axis  pitch  rate  (deg/sec,  rad/sec) 

9 - pitch  attitude  (deg,  rad) 

SQ  - input  which  is  designed  to  produce  a pitching  moment 
s 

- input  which  produces  thrust 

The  F and  G matrices  at  an  airspeed  of  65  knots  are  given  below.’ 


J 


-.18 

-.03 

9.57 

-31.87 

-.2 

-.55 

109.43 

2.78 

-.01 

-.0177 

- .09 

0 

0 

0 

1 

0 

-.356 

.52 

0 

-1 

.33 

.021 

0 

0 

The  open-loop  transfer  functions  with  respect  to  both  the  inputs  are  given  in 
Table  5-1.  The  longitudinal  dynamics  of  the  X-22A  at  an  airspeed  of  65  knots 
are  typical  of  unaugmented  VTOL  aircraft  in  this  flight  regime.  The  short 
period  dynamics  are  characterized  by  lightly  damped  complex  roots  while  the 
phugoid,  which  is  normally  oscillatory  and  stable  in  high  speed  flight  has 
degenerated  into  a real  pair,  one  of  which  is  unstable.  Because  of  this  un- 
stable root,  the  unaugmented  X-22A  would  not  meet  the  level  requirement  of 
the  specification  MIL-F-83300  for  longitudinal  dynamic  response. 

An  augmentation  concept  which  has  produced  satisfactory  pilot 
ratings  under  instrument  flight  conditions  in  the  X-22A  is  attitude  command 
augmentation.  This  augmentation  system  employs  pitch  rate  and  attitude  feed- 
back to  the  pitching  moment  controller  to  augment  the  frequency  and  damping 
of  the  short  period  roots  and  to  stabilize  the  aperiodic  roots.  To  achieve 
the  desired  objectives  the  first  design  procedure  described  in  Section  3 was 
used. 

The  first  step  is  to  transform  the  equations  of  motion  of  the 
X-22A  into  diagonal  form.  With  the  transformation 
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TABLE  5-1 

OPEN-LOOP  TRANSFER  FUNCTION  CHARACTERISTICS 


CHARACTERISTIC  EQUATION 
s4  + .82s3  + 2.19s2  + .0735s  - .0544 
Poles 


Real 

Imaginary 

w 

■.389 

1.426 

.263 

1.48 

■•389 

-1.426 

.138 

-.1806 

ZEROS  OF  TRANSFER  FUNCTIONS 

Zeros 


Transfer  Functions 

Real 

Imaginary 

u 

- .48 

es 

4.36 

3.86 

4.36 

-3.86 

w 

- .099 

- .099 

.231 

- .231 

_a_ 

o 

es 

- .576 

- .165 

9 

■*es 

- .576 

- .165 

u 

£ 

.723 

- .9 

1.26 

- .9 

-1.26 

.006  .48 

.006  - .48 

1.91 
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TABLE  5-1  (CONT'D) 


Zeros 


Transfer  Functions 


9 

■*7 


Real 

0 

-1.17 

-1.56 

-1.17 

-1.56 


Imaginary 


where 


L, 


U 


x = T 


x = 


' Au  ' 

Aw 

Aq 

_Ae  _ 

. 

22.758 

32.998 

1.3363 

-.04901 


-12.709 

-95.562 

.28934 

-.9241 


•195.55 

107.05 

.26646 

1.93 


273.48 

-154.64 

-.02582 

.143 


' ' 

h 

h 

J 

L ^4  J 

the  system  of  equation  (1)  is  transformed  into  the  block  diagonal  form 


where 


h 

- .3887 

1.426 

0 

0 

CM 

-1.426 

- .3887 

0 

0 

• 

#3 

= 

0 

0 

.138 

0 

• 

h. 

_ 0 

0 

0 

-.181 

’ .216 

.012  * 

= T 

r1  g = 

.097 

.012 

.05 

.006 

.021 

.0055 

(2) 


The  performance  index  to  be  minimized  is 

00 

1 r t ~ t 

J * J J Q]>  + “ Ru)dt 


In  the  first  step  the  two  complex  poles,  corresponding  to  the 
short  period  mode,  are  moved  to  more  desirable  locations.  The  short  period 
natural  frequency  and  the  damping  ratio  were  specified  to  be 


u>  - 2 1 .5  rad/sec 
5P 

S ' -6  2 -2 
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The  weighting  matrix  on  the  control  was  chosen  for  convenience  to  be 


~2  o' 

0 7 


A different  choice  of  R would  result  in  a different  Q matrix  to  achieve  the 
design  objectives. 

The  matrix  was  selected  so  that  the  closed-loop  short  period 
natural  frequency  and  the  damping  ratio  would  be  in  the  desired  range.  The 

V L 

matrix  was  determined  to  be 


^1  = 


25.173 

0 

0 

0 


0 

25.173 

0 

0 


0 

0 

0 

0 


and  the  short  period  characteristics  are  given  by 


= 1.59 

5sP  = .443 

P 

The  matrix  of  the  performance  index 


OO 

J * j J (xT  x + uT  Ru)dt 


is  given  by 


-T  - -l 
Qx  = T 1 Qx  T 1 

The  gain  matrix  Kj  corresponding  to  Q1>  the  matrix  Qj,  the  closed-loop  matrix 
Fj  ■ F - GKj  and  the  transfer  function  characteristics  are  given  in  Table  5-2, 

Thus  far,  the  two  complex  poles  have  been  moved  to  more  desirable 
locations  and  the  zero  movement  determined.  It  is  to  be  noted  from  Table  5-2 
that  the  open-loop  unstable  pole  has  been  shifted  to  its  mirror  image  in  the 
left  half  plane.  This  is  the  property  of  optimal  control  design.  The  stable 
open-loop  pole  has  remained  at  the  same  location.  The  zeros  of  the  transfer 
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TABLE  5-2 

Fj,  Q and  Kj  MATRICES  AND  THE  CORRESPONDING 
TRANSFER  FUNCTIONS 


-.184 

-.037 

10.51 

-30.93 

! Fx  = -.201 

-.551 

109.5 

2.88 

-.006 

-.011 

- .99 

- .93 

0 

0 

1 

0 

0131 

- .021 

2.72 

2.81 

.2  x 

10-4  -8.43  x 

10"4  .061 

.092 

0006 

.001 

.009 

.003  ’ 

001 

.00197 

- .0198 

.0058 

0091 

-.0198 

12.97 

-.162 

003 

.0058 

-1.62 

.21 

TRANSFER  FUNCTION  CHARACTERISTICS 
Characteristic  Equation 
s4  + 1.72s'3  + 2.98s2  + .836s  + .063 
Poles 


Real  Imaginary  3 

-.702  1.42  .443 

-.702  -1.42 

-.138 
-.181 

Zeros  of  Transfer  Functions 

Zeros 

Transfer  Function  Real 

-r~  - .484 

es 

4.34 

4.34 

-j—  -.0996 

*S  -.0996 


Imaginary 


3.88 

-3.88 

.231 
- .231 
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TABLE  5-2  (CONT'D) 
Zeros 


function  of  the  pitch  attitude  to  pitch  control  commands  are  affected  by 

feedback  from  the  second  input,  the  thrust  control  command.  It  is  seen  from 

Table  5-2  that  the  elements  of  the  second  row  of  the  feedback  gain  matrix 

corresponding  to  the  feedback  from  the  second  input  are  small  and  have  not 

moved  the  zeros  of  6/<f  significantly  from  their  open-loop  values. 

es 

In  the  next  step  one  of  the  real  poles,  A = -.13805,  is  moved 

close  to  one  of  the  zeros  of  9/<f  transfer  function.  To  do  this,  the  new 

es 

system  of  equations 


x = x + Gu 


is  transformed  into  block  diagonal  form  again  with  the  transformation 

x * T2  > 

where 


' -20.92 

7.89 

237.28 

1018. 

7 

T2 

* 

-55.55 

71.22 

-108.9 

- 576. 

05 

- .88 

-.824 

.297 

-.0962 

• 

. " *22 

.73 

-.215 

.532 

J 

The 

transformed  equations  are 

given  by 

• 

h 

-.702 

1.421 

0 0 

• 

*2 

-1.421 

-.702 

0 0 

• 

= 

♦ G= 

*3 

• 

0 

0 

.13805  0 

l/t 

j 

0 

0 

0 -.1806 

where 


so  that  the  pole  at  -.13805  was  moved  to  -.5762.  The  weighting  matrix  Q2 


corresponding  to  the  x states  is  given  by 

■ V1  % V‘ 

The  final  closed-loop  dynamic  matrix  Fc  = (F^  - GK2)  where  K.,  is  the  gain 
matrix  corresponding  to  the  weighting  matrix  Q^,  the  final  weighting  matrix 
Q - Qi  ♦ Q2>  t^e  final  gain  matrix  K and  the  transfer  function  characteris- 
tics are  given  in  Table  5-3. 

It  is  to  be  noted  that  with  sufficiently  high  feedback  gains,  one 
of  the  real  poles  and  one  of  the  zeros  of  0/6^  transfer  function  are  driven  into 
close  proximity  to  one  of  the  zeros  of  the  0/6e  transfer  function  so  that  the 
aperiodic  pair  is  close  to  the  zeros  of  0/6e  and  0/6^  transfer  functions  and  the 
attitude  response  to  pitch  control  commands  is  essentially  second  order. 

The  advantages  of  an  attitude  command  augmentation  system,  com- 
pared to  a simpler  concept  such  as  rate  command  augmentation,  are 
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TABLE  5-3 
IICES  AND  1 
TRANSFER  FUNCTIONS 


F , Q and  K N5ATRICES  AND  THE  CORRESPONDING 
c 


" -.191 

- .048 

10.95 

-29.28 

F = 

-.201 

- .552 

109.53 

3.03 

c 

.0011 

-1.57  x 

0 

1 

1 

H-* 

• 

r j 

- 2.52 

L 0 

0 

i 

0 

■-.034 

- .053 

4.02 

7.63 

K = 

-.0012 

- .0019 

.102 

.246 

.002 

.0033 

- .096 

- .321 

Q = 

.0033 

.0053 

- .16 

- .5 

-.096 

- .16 

18.5 

18.9 

.321 

.5 

18.9 

76.41 

Real 

TRANSFER  FUNCTION 

Characteristic 
s4  + 2.16s3  + 3.68s 
Poles 

Imaginary 

CHARACTERISTICS 

Polynomial 

2 + 2.05s  + .261 

J 

w 

■•702 

1.42 

.442 

1.59 

-.702 

-.181 

-.576 


-1.42 


Zeros  of  Transfer  Functions 

Zeros 


Transfer  Function 
u 


'es 


Real 

- .486 
4.33 
4.33 

- .1 
- .1 


Imaginary 

3.89 

-3.89 

.232 
- .232 
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TABLE  5-3  (CONT'D) 


(1)  The  pilot  can  estimate  the  magnitude  of  commanded  attitude 
changes  by  the  magnitude  of  his  applied  stick  force  or  dis- 
placement. 

(2)  If  unattended  (stick  force  relaxed)  the  vehicle  will  return 
to  the  trim  attitude. 

(3)  Rate  feedback  alone  cannot  stabilize  an  unstable  aperiodic 
root. 

The  pole-zero  locations  of  the  Q/6e  and  Q/6t  transfer  functions 
at  different  stages  in  the  design  process  are  sfiown  in  Figure  5-1.  Figure 
5-1 (a)  shows  the  open-loop  pole-zero  locations.  Figure  5-1  (b)  shows  the  pole- 
zero  locations  after  the  pair  of  complex  poles  corresponding  to  the  short  per- 
iod roots  are  moved  to  more  desirable  locations.  The  use  of  the  optimal  con- 
trol design  procedure  also  moves  the  unstable  pole  to  its  mirror  image  in  the 
left-half  plane.  The  numerator  zeros  of  9/ 6^  have  moved  very  little  from 
their  open-loop  locations  with  the  initial  feldback.  Figure  5-1  (c)  shows  the 
final  pole-zero  locations  and  the  two  real  poles  approximately  cancel  the  zeros 
of  the  and  9/6^  transfer  functions.  Thus,  the  attitude  response  to  pitch 

control  commands  is  essentially  second  order  dominated  by  the  modified  short 
period  mode.  The  responses  of  pitch  attitude  and  pitch  rate  to  pitch  control 
step  command  are  shown  in  Figure  5-2.  The  time  history  illustrates  the  second 
order  nature  of  attitude  response. 

The  design  example  presented  in  this  section  has  demonstrated  the 
. ;«f'uln«ss  of  the  step  by  step  approach  formulated  in  Section  3 to  practical 
i svstens  design.  The  second  design  procedure  discussed  :n  Section  3 
. - the  eigenvector  approach)  is  considered  to  be  more  promising 

• . reased  tractability  of  the  modified  system  by  the  control  sys- 

Vdditional  study  is  required  before  it  can  be  used  in  a systema- 
tical control  systems  design. 
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Section  6 

SUMMARY  AND  RECOMMENDATIONS 


Application  of  linear  optimal  control  has  developed  several  con- 
•j  trol  system  design  procedures  that  can  be  used  to  design  a multicontroller 

feedback  system  to  satisfy  flying  qualities  and  other  control  systems  design 
criteria.  Specifically,  two  design  procedures  were  given  in  Section  3 to  de- 
termine the  pole-zero  movement  as  the  performance  matrix  is  varied.  The  pro- 
cedures given  were  step-by-step  procedures  where  at  each  stage  a pole  was  moved 
and  the  zero  movements  determined.  The  performance  index  weighting  matrices 
constructed  at  each  stage  to  move  the  poles  and  zeros  were  added  to  get  a final 
performance  index  weighting  matrix  that  moves  the  open-loop  poles  arid  zeros  to 
more  desirable  locations.  The  procedure  can  be  used  in  as  many  steps  as  are 
required.  The  design  procedure  based  on  the  eigenvector  approach  is  the  more 
promising  of  the  two  procedures  presented  in  Section  3 since  the  closed-loop 
eigenvectors  are  computed  at  each  stage  to  determine  the  zero  movements  and 
give  better  insight  into  the  design  process  at  each  stage.  In  Section  4,  two 
alternative  design  techniques  were  presented.  The  first  technique  was  based 
on  design  in  terms  of  the  Riccati  solution  and  the  weighting  matrix  on  the 
control  rather  than  on  the  states  and  control.  It  was  shown  that  design  in 
terms  of  the  Riccati  solution  and  the  control  weighting  matrix  guaranteed  that 
the  feedback  gain  matrix  result  was  optimal.  In  the  second  technique,  the  first 
order  changes  in  transfer  function  poles  and  zeros  were  determined  under  pertur- 
bations in  the  performance  index  matrices.  This  could  be  used  to  develop  an 
iterative  design  procedure  for  pole-zero  placement. 

In  Section  5 the  first  design  procedure  developed  in  Section  3 
was  applied  to  a control  system  design  using  the  X-22A  V/STOL  airplane  as  the 
model.  The  design  was  carried  out  in  two  stages  to  achieve  attitude  command 
augmentation.  The  example  illustrated  the  ideas  involved  in  the  design  proce- 
dure. 


This  study  has  shown  the  usefulness  of  the  design  procedures,  based 


on  the  step-by-step  approach,  to  practical  control  systems  design.  The  pole- 
zero  movements  are  determined  directly  at  each  step  as  the  performance  index 
matrix  elements  are  varied.  Further  work  is  required  to  develop  these  design 
procedures  into  a viable  control  systems  design  tool,  and  to  examine  problems 
in  optimal  control  systems  design  which  have  not  been  addressed  in  this  study. 
The  following  recommendations  for  further  work  are  therefore  in  order: 

• The  design  procedure  based  on  the  eigenvector  approach  is  con- 
sidered to  be  more  promising  because  of  increased  tractabil- 
ity  of  the  modified  system  at  every  stage  of  the  design  pro- 
cess. Further  work  is  required  to  develop  the  eigenvector 
approach  into  a more  systematic  procedure  by  using  it  to 
design  practical  control  systems. 

• The  design  techniques  given  in  Section  4 need  further  develop- 
ment for  use  in  control  systems  design. 

• The  effect  of  proximity  of  the  transfer  function  zeros  to  the 
transmission  zeros  needs  investiagtion.  Since  the  transmis- 
sion zeros  are  invariant  under  feedback,  high  feedback  gains 
may  be  required  to  move  a transfer  function  zero  away  from  a 
transmission  zero  if  required. 

• Optimal  control  design  technique  requires  full  state  feedback. 
In  many  practical  situations,  not  all  the  states  are  avail- 
able for  feedback.  Further  work  is  required  to  determine  the 
conditions  under  which  optimal  control  design  technique  can 

be  used  with  partial  state  feedback. 

• An  important  practical  problem  in  control  systems  design  is 
the  failure  of  a feedback  path  due  to  a sensor  failure.  The 
effect  of  this  failure  on  the  stability  and  transfer  function 
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characteristics  of  the  closed-loop  multicontroller  system 
needs  to  be  investigated  to  examine  the  possibility  of  de- 
signing optimal  control  systems  that  remain  stable  under  a 
wide  class  of  failure  modes. 
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APPENDIX  A 

INVERSION  OF  A MATRIX  OF  A PARTICULAR  FORM 


It  is  required  to  invert  a matrix  A of  the  following  form: 


The  inverse  of  the  matrix  can  be  found  as  the  solution  of  a set 
of  linear  equations  as 

Ax  = y (2a) 

x = A * y (2b) 


Equation  (2a)  can  be  written  as 


The  solution  for  x^  from  the  above  set  of  equations  is  given  by 


A- 1 


APPENDIX  B 

INVERSION  OF  A MATRIX  OF  A PARTICULAR  FORM 


The  inversion  of  the  following  matrix  is  required: 


1 0 


The  inverse  can  be  obtained  as  the  solution  of  the  set  of  linear 


equations 


The  solution  is  given  by 


X1  * yl 

a2  X1  + x2  = y2 
X2  = ”a2  yi  + y2 


a3  X1  + x3  3 y3 


X3  = "a3  yi  + y3 
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